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ABSTRACT 

'  '  > 

-  \  • 

Consider  the  hypothesis  :  0^  2:  0^  ^  ^  G^  regarding  a  collec¬ 

tion,  0^,6  ,•■•,6  ,  of  unknown  parameters.  It  is  clear  that  this  trend 
is  reflected  in  certain  possible  parameter  sets  more  than  in  others.  A 
quantification  of  this  notion  of  conformity  to  a  trend,  which  was  sug¬ 
gested  by  Barlow  and  Brunk  (1972),  is  studied.  Applications  of  the 
resulting  theory  to  several  order  restricted  hypothesis  tests  art- 
presented. 
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1.  Introduction.  Order  restricted  statistical  inference  is  concerned 
with  procedures  which  take  into  account  information  relating  to  the  magni¬ 
tudes  of  parameters  indexing  the  population  or  populations  of  interest. 

For  example,  suppose  are  means  ^  normal  popula¬ 

tions  and  suppose  that  it  is  known  or  suspected  that  they  satisfy 

(1.1)  Hl  :  ^  i  ^  i  ...  i  Mfc. 

Estimates  and  test  procedures  which  take  this  information  into  account 
were  first  studied  in  the  mid-50's  and  a  number  of  names  are  associated 
with  this  work.  Much  of  this  theory,  together  with  the  history  of  these 
problems,  is  discussed  in  Barlow,  Bartholomew,  Bremner  and  Brunk  (1972). 
Throughout  this  paper  it  will  be  convenient  to  think  of  a  vector  such  as 
M  =  (pi^  ,pi?  ,•  •  •  ,pi^)  as  a  parameter.  In  case  the  parameter,  pi,  is  a 
vector  then  pi.  will  denote  its  i~  coordinate. 

l 

In  hypothesis  testing  the  objective  is  to  use  certain  experimental 
results  to  either  confirm  or  reject  or  a  similar  hypothesis.  It 

seems  clear  that  is  more  likely  to  be  confirmed  when  sampling  from 

certain  populations  than  when  sampling  from  others.  For  example,  if 
k  =  3  then  H,  is  more  likely  to  be  confirmed  when  pi  =  (!»,?, 0)  than 
when  pi  =  (2,2,2).  It  seems  reasonable  to  say  that.  (U,2,0)  conforms 
more  closely  to  than  does  (2,2,?).  A  quantification  of  this,  notion 

of  conformity  to  a  hypothesis  would  be  a  very  useful  tool  in  order 
restricted  inference.  For  example,  in  hypothesis,  testing,  "good"  test 
procedures  should  have  error  structures  having  monotone  properties  when 


/ 


2 


evaluated  at  possible  parameters  which  are  comparable  under  this  notion 
of  conformity  (cf.  Section  3.1*).  In  a  Bayesian  approach,  one  might  search 
for  priors  which  assign  higher  probabilities  to  parameters  conforming  more 
closely  to  the  order  restriction. 

How  can  we  quantify  this  concept?  One  approach  would  be  through 
distances  to  the  hypothesis.  Specifically,  if  H  denotes  the  collec¬ 
tion  of  points  satisfying  our  hypothesis  then  for  any  point,  pi,  we  could 
measure  the  distance  from  pi  to  in  some  way.  One  problem  with  such 

an  approach  would  be  that  d(pi,H^  )  =  0  for  all  pi  €  so  that  we  could 
not  distinguish  between  such  points  and  clearly  some  such  points  conform 
more  closely  than  do  others. 

Barlow  and  Brunk  (1972)  mentioned  another  idea  which  does  not  seem 
to  have  been  explored  in  any  depth  in  the  literature.  Consider  the  rela- 
tion,  »,  defined  on  Euclidean  space,  R  ,  by  x  =  (x^ ,x^ , • • • ,x^)  >> 
y  “  (y1>y2» • • • »yR)  if  and  only  if 

(1.2)  E1  x  a  Z1  y  ■  i  =  1 ,2 , •  •  •  ,k-l 

j=l  J  J=1  J 

and 


(1.3) 


It  is  obvious  that  »  is  related  to  the  concept  of  stochastic  ordering 
and  it.  is  straightforward  to  verify  that  it  is  a  partial  order. 

k 

Let  C  be  the  subset  of  R  consisting  of  all  those  points 
x  3  ( x^  ,x_, , •  •  •  ,x^  )  such  that  x^  2  x,,  S  •  •  •  2  x^.  If  both  x  and  y 
lie  in  C  then  x  »y  is  equivalent  to  "x  majorizes  y"  in  the  Schur 
sense  (cf.  Hardy,  Lit.tlewood  and  Polya  (1Q73)).  Cchur  majori  zati  on  has 
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been  used  as  a  quantification  of  the  notion  of  dispersion.  Thus,  if 
x  »y  and  if  x,y  €  C  then,  in  some  sense,  the  coordinates  of  x  are 
more  dispersed  than  those  of  y. 

It 

Viewing  C  geometrically  as  a  subset  of  Euclidean  k  space,  R  , 
it  is  a  closed  convex  cone.  It  is  reasonably  straightforward  (cf.  Theorem 
2.1)  to  see  that  x  »  y  if  and  only  if  y-x  is  in  C *,  the  dual  cone  of 
C,  (cf.  Barlow  and  Brunk  (1972)).  The  cone  C*  is  the  set  of  all  points 
z  €  R*  such  that  the  inner  product  ^x.z^,  is  nonpositive  for  all 

x  €  C.  The  cones  C  and  C*  together  with  an  arbitrary  point  x  and 
£y  :  y  »  x}  are  pictured  in  Figure  1. 


This  geometry  suggests  a  second  quantification  of  conformity,  namely 
x  «  *y  if  and  only  if  y-x  €  C.  We  will  have  this  second  quantification 
in  mind  and  also  explore  its  properties. 

Consideration  of  the  case  k  =  2  is  also  informative.  The  set  C  is 
simply  the  set  of  points  pictured  in  Figure  2  which  lie  to  the  lower  right 

p 

of  the  diagonal  line  x^  =  x  .  If  x,y  €  R  and  if  x  »  y  then  (1.3) 
requires  that  x  and  y  lie  on  the  same  diagonal  line  (having  slope  -1  ) 


and  (1.2)  requires  that  x  is  to  the  right  of  y.  Thus  if  y  €  C  then  so 
is  x  and  x  is  "deeper"  in  C  than  is  y.  If  y  (E  C  then  x  is  closer 
to  C  than  is  y.  The  set  lx;  x  »*  y]  is  the  set  of  all  points  which 
lie  to  the  lower  right  of  the  diagonal  line  through  y  having  slope  !. 

In  Sect:  cm  2,  properties  of  the  partial  order,  «,  are  developed. 

In  Section  3  we  prove  two  preservation  theorems  which  say  that  if  u  func¬ 
tion  is  isotonic  with  respect  to  this  partial  order,  if  a  statistic  is. 
formed  from  the  data  using  this,  function,  and  if  two  parameter  values,  are 
ordered  by  «,  then  the  "larger”  parameter  value  produces  the  l;crger 
expected  value  of  the  statistic.  Several  examples  are  considered  in  Sec¬ 
tion  U.  In  Example  I*. I  the  preservation  theorems  developed  in  Section  1 
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are  used  to  argue  monotone  properties  of  certain  power  functions.  In 
addition,  those  preservation  theorems  are  used  to  argue  the  least  favor¬ 
able  status  of  certain  parameter  configurations  for  tests  where  the  null 
hypothesis  is  not  simple.  In  Examples  h .2  and  U.3  testing  problems  are 
considered  where  one  of  the  hypotheses  imposes  a  relationship  using  « 
on  two  parameter  sets.  It  is  interesting  to  note  that  the  chi -bar- 
squared  distribution,  which  is  used  extensively  in  order  restricted 
hypothesis  testing,  arises  again  in  this  context. 


C.  Properties  of  ».  The  following  theorem  is  proved  in  Section  Four 
of  Barlow  and  Brunk  (l^TS). 


Theorem  2.1 .  If  x,y  £  R  then  a  necessary  and  sufficient  condition  for 
x  »  y  is  that 

(.M)  I*  (y.-x.  )z.  £  0 

i=l  i  1  l 


for  al '  /.  e  C. 

Remark.  If  A  R  and  if  A  has  a  lower  bound  with  respect  to  » 
then  A  has  a  greatest  lower  bound. 

Proof:  The  greatest  lower  bound  is  the  vector  1=  ( l  , , • ■ • , ^ )  whose 
coordinates  are  t.he  solutions  to  the  k  equations 

=  it'fbj  ♦  •••  +y;i  y  fA);  \  -  1  ,P , •  •  •  ,k . 
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It  is  convenient,  at  this  point,  to  introduce  some  notation.  Let  |J’|[ 

denote  the  norm  on  Rk  defined  by  |jx||2  =  x?.  For  each  point  x  €  Rk 

i=l  1 

let  P(x|c)  be  the  point  in  C  which  minimizes  h(z)  =  ||X-z|J  2.  The 
point  P(x|c)  is  termed  a  projection  of  x  onto  C  and  properties  of  the 
operator  P("|c)  are  discussed  in  Brunk  (1965). 

Theorem  2.2.  The  point  P(x]c)  is  equal  to  the  greatest  lower  bound  of  the 
set  of  all  points  z  in  C  such  that  z»x  (i.e.,  P(x|c)= 

inf{z  € C ;  z  » x})  • 


Proof:  Let  x  =  P(x|c)  =  (x  jX^,' • • ,x^)  and  note  (by  (2.L)  of  Brunk  (1965)) 
that  x  €  [z  €C;  z»x}  so  that  this  set  is  nonempty  and  if  x  is  a  lower 


bound  it  must  be  a  greatest  lower  bound.  Let  x  =  •••  =x.  >  x. 

1  X1  V1 


x.  >  • • •  >  x.  .=•••=  x^  so  that  x  has  a  level  sets.  Suppose 

x2  1a-l+1  a 

y  €  C,  y  »  x  and  i  +1  £  j  <  i  .  Then  x.  =  (x.  ..  +  •• *+x.  )/(i  ,.-i  ) 

r  r+1  j  ir+l  ir+1  r+1  r 

and  using  well  known  properties  of  x,  we  write: 


j  _  ir  ir+l 

L  x.  =  X  x.  +  j, - L 

i=l  1  i=l  1  i=i  -1 


Lr+l~1r  i=i  +1  1 


J  xr  J-1r  vlr+1 

=  1  -  - - ~  L  x.  +  - - h—  L  x. 

1  a.!-1  1=1  1  1  .l-1  1=1  1 

r+1  r  1  x  r+1  r  1  L 


J-ir  >lr  >+1 

£  j  _  - L —  V  +  - ! v 

i  i*l  i  ir +1‘lr  i=l  1 


*r  ^r+1 

=  L  y.  +  - - -  L  y. 

i=l  1  1r+r1r  i  =  ir+l  1 


L.  . y 1  +  T7-  L. 


si,  y.  +  -T\  l  y- 
1  =  1  1  J-1r  i  “  i  +1  1 

r  r 


=  zi=iyi  • 


t 
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The  last  inequality  is  because  y  a  y  s  • • •  £  y  so  that  the  average  of 

J-  <-  K 

the  values  of  y^  over  i  +1  to  j  is  at  least  as  large  as  the  average 

over  i  +1  to  i  , , .  It  is  well  known  that  x.  =  x.  so  that 

r  r+1  i=1  i  i=1  i 

since  j  is  arbitrary,  this  completes  the  argument. 

Corollary  2.3.  If  x  »  y  then  P(xjc)  »  P(y|c). 

Proof:  This  follows  from  Theorem  2.2  and  the  observation  that 
{z  €C;  z  »x}  c  [z  €C;  z>>y]  . 

Note :  The  above  result  does  not  follow  from  Theorem  7.9  in  Barlow  et  al . 
(1972)  since  their  (7.19)  fails  for  ». 

Definition.  If  f  :  R  — »  R  then  we  say  f  is  ISO  if  and  only  if  x  »  y 

implies  that  f(x)  £  f(y)  (i.e.,  f  is  isotonic  with  respect  to  ») . 

Note  that  any  function  which  depends  on  xi,X2’* *',Xk  °nly  through 

1  x.  is  ISO. 
i=l  1 

K 

Theorem  2.7.  If  x,y  €  R  then  x  »  y  if  and  only  if  f(x)  s  f(y)  for 
all  f  which  are  ISO. 

j 

Proof:  Use  the  fact  that  the  function  g(x)  =  Z  x.  is  ISO  for  all  ,j . 
-  i=l  1 

For  any  function  f  of  k-real  variables  let  f.  denote  the  partial 
derivative  (if  it  exists)  of  f  with  respect  to  the  i^-  variable. 
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Theorem  2.5.  If  the  function  f  :  R  — *  R  is  differentiable  and  if 

f.(x)  2  f  (x)  for  all  x  and  for  all  i  sk-1  then  f  is  ISO. 
l  x+1 

Proof :  Sunpose  x  <<  y.  Using  the  mean  value  theorem  there  exists  a  point 
z  on  the  line  segment  joining  x  and  y  such  that 

f(x)-f(y)  =  E  (x.-y.  )f .  (z) . 

i=l  i  i  i 

Our  hypothesis  implies  that  the  point  (f  (z) ,f  (z) ,  • * •  ,f  (z))  is  in  C  so 

1  c  K 

that  f(x)  £  f(y)  from  Theorem  2.1. 

Example  2.1.  Chacko  (1966)  (cf.  also  Robertson  (1978))  studied  a  likelihood 
ratio  test  for  testing  the  equality  of  a  collection  of  multinomial  parameters 
when  the  alternative  is  restricted  by  the  trend  H  :  p  s  p  a  •••£  p  . 

-L  _L  <—  K 

Theorem  2.5  can  be  used  to  show  that  the  power  function  of  this  likelihood 

ratio  test  is  ISO  on  C.  Suppose  we  have  a  random  sample  of  size  n  and 

that  the  resulting  success  frequencies  are  (i.e.,  the  random 

vector  (X  ,XQ , • • • ,X^ )  has  a  multinomial  distribution  with  parameters 

n,  u  , p  , •••,p  ).  For  each  positive  integer  m,  let  A  be  the  set  of 
1  d  K  m 

all  k  tuples  of  nonnegative  integers  whose  sum  is  m  and  let 

k 

B  =  ‘  ,Pk>  ’  pi20;  i  =  1,2,*  •  •  ,k,  I.  P.  =  1]  • 

Theorem  2  .6.  If  f  (  • )  :  A  — *  R  is  ISO  then  h( n  ,t>„  ,  •  •  •  ,t.  )  = 

-  n  1  2  k 

E[f(X  ,X  ,--*,Xk)]  is  ISO  on  B. 

Proof :  Fix  i  and  consider  the  partial  derivative. 
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X1  V1  *k 


h  (p)  =  I  f(x)  •  (  )x.  p,1"  p.1  •■•P; 

i  x€A  xn  ,x0,  ,x^  i  l  1 


1’V"’5^ 


n-1 


n-1 


y€A„  ,  1  i  k  y,  ’  ’-yu  1 


yi  7k 


Thus , 


h.  (p)  -  h.(p)  =  £  [f(y_, ,  •  •  •  ,y.+l,  -  •  •  ,y  )  -  f(y  ,•  •  •  ,y  +1 ,  -  •  ,y.)] 

1  J  y€An_i  11  k  l  J  k 

/  n-1  v  Y1  yk 

•  n(  )  p  • •  •  p 

yl ’  “  ‘  ,yk  1  k 


and  if  j  >  i  then  (y  ,  •  ••  ,y .+1 ,  • • •  ,yk )  »  (y^  ,  • • *  ,y ^+1 ,  • • •  ,y^ )  for  all 

v  €  A  The  desired  result  follows. 

J  n-1 


In  testing  H  :  p  =  k  1  *  (l,l,***,l)  against  H^-Hp  the  likelihood 

ratio  statistic  T,  =  -2  In  X  =  2^  x.  In  x.  -  ?n  In  n  +  2n  In  k  where 
01  i=l  1  1 

x  =  (x^,-,,,x^)  =  p(x]C).  In  order  to  show  that  the  power  function  of 

,k 

T  is  ISO,  it  suffices  to  show  that  the  function  ^  x.  In  x. 

01  i=l  i  i 

=  X7  x.  In  x.  (cf.  Corollary  3.1  in  Brunk  (1965))  is  ISO 
r-l  t  i 

on  C.  But  x  »  y  implies  that  x  »y  by  Corollary  .3  so  that  it  suf¬ 


fices  to  show  that  the  function  x.  In  x.  is  ISO  on  C.  Consider 

i=l  1  1 

a  =  (x^  ,•  •  •  ,x.+6,‘ •  •  ,x^)  and  b  =  (x^  ,  ■  •  •  ,x  .  +  5, —  ,x^)  where  x  €  C, 

x.  >  x  ,  i  <  j  and  0  <  6  <  x.-x  .  It  suffices  to  show  that 
1  J  i  J 

vk  ,k 

L  a.  In  a.  &  L  b.  In  t.  .  However,  the  difference  of  these  two  sums  can 
i=l  1  1  i=l  1  1 

x.  -*-6  x  .  +  6 

be  written  J  (l+lny)dy-  J  **  (l+lny)dy,  which  is  nonnegati ve  by 


x. 


our  as sump t i ons , 


Thus  In  testing  HQ  against.  H  -H  the  likelihood  ratio  statistic 


/ 


has  a  power  function  which  is  ISO.  In  Section  Four  the  preservation 
theorems  presented  in  Section  Three  will  he  used  to  obtain  additional 
results  of  this  nature. 

3.  Preservation  Theorems .  The  theorems  in  this  section  have  a  number  of 
potential  applications.  They  can  be  used,  as  in  Section  U,  to  argue  that 
the  power  functions  of  test  statistics  which  have  been  proposed  for  cer¬ 
tain  order  restricted  problems  are  ISO.  Also  in  Section  I*  they  are 
used  to  show  the  least  favorable  status  of  certain  parameter  configurations 
in  problems  where  the  null  hypothesis  does  not  completely  specify  the  dis¬ 
tribution  of  the  test  statistic. 

Theorem  3.1.  Suppose  [P^;  A€A]  is  a  family  of  probability  measures  on 

K  k 

the  Borel  subsets  of  R  ,  where  A  c  R  .  Assume  that  if  a  k-dimensi  onal 

random  vector  X  has  distribution  then  X  -  A  has  distribution  Q 

k 

where  Q  is  independent  of  A.  If  f  :  R  — »  R;  if  f  is  ISO  and  if 
h  :  A  — *  R  is  defined  by 

h(A)  =  f(x)dP^(x) 
then  h( • )  is  ISO  on  A. 

Proof :  Assume  A  »  6  and  that  both  belong  to  A.  Using  two  changes  of 


variables  we  write 
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h(X)-h(6)  =  Jf(x)dP^(x)  -  Jf(x)dP^(x) 
=  Jl f (y+X)  -  f (y+6) ]dQ(y ) 


which  is  nonnegative  since  y  +  X  »  y  +  b  for  all  y. 

£ 

An  analogous  result  holds  for  «  .  More  precisely,  suppose  we  say 

£ 

that  a  function  is  ISO  provided  it  is  isotonic  with  respect  to  the  par- 
tial  order  «  .  Under  the  assumption  of  Theorem  3-1,  if  f ( * )  is  ISO 
then  so  is  h( • ) ■ 

The  proof  of  the  next  theorem  is  an  adaptation  of  the  argument  given 
for  Theorem  1.1  in  Proschan  and  Sethuraman  (1977). 

Theorem  3*2.  Suppose  A  is  a  subset  of  the  real  line  which  is  closed 

under  addition  and  assume  that  &(',’)  is  a  nonnegative  function  on  A  x  R 

such  that  0(a,x)  =  0  for  all  a  and  for  all  x  <  0.  In  addition,  assume 

that  0( ■ , * )  satisfies  the  semigroup  property  with  respect  to  n  on  the 

Borel  subsets  of  R  (cf.  Proschan  and  Sethuraman  (1977)).  (We  assume 

that  jj  is  either  Lebesgue  measure  or  counting  measure  on  the  nonnegative 

k.  k 

integers.  )  Suppose  f  :  R  — »  E  is  ISO  and  h  :  A  — »  R  is  defined  by 

h(a-j  »a2»‘ "  »\)  =  JJ' •  •/f(x)IIk^^0(ai  ,xi)dM(x1)  •  •  ^(xj^) 

where  the  integral  is  assumed  finite.  Then  h  is  ISO. 

Proof:  The  argument  for  k  =  2  is  similar  to  the  proof  of  Lemma  2.1  in 
rrosehan  nnd  Sethuraman  (1977).  We  proceed  by  induction.  Assume  k  3 


1? 


and  (a1»a2,  •  •  •  ,a^)  »  ,b2 ,  •  •  •  ,b^  ) .  Define  c  €  R  by  =  b  , 

c2  =  a2  +  a1  -  b1 ,  =  a^,  • • •  ,c^  =  .  Write  h(a)  -  h(b)  = 

h(a)  -  h(c)  + h(c)  -  h(b)  and  consider,  separately,  the  two  differences.  The 

first  difference  can  be  written, 

h ( a )  -  h ( c )  =  //•••j‘[jjf(x)0(a1,x1)0(a2,x2)d|i(x1)dn(x?) 

-  J*J*f ( x )  0{c1,x1  )  (z>(c2,x2)dii(x1)dia(x0)jnk  0(a.  ,x.  )du(x^)  •  •  *d|j(x^) 

Tlie  quantity  inside  the  brackets  is  nonnegative  by  the  case 
k  =  2  since  (a^,a2)  »0  (0^,0^)  and  since  with  > ■ • ■  ,x^  held  fixed 

O 

the  function  f  (  •  ,  •  ,x^  ,x^  ,  •  •  •  ,x^  )  is  ISO  on  R'_ .  The  second  difference, 

h(c)  -  h(b)  is  handled  similarly  using  the  induction  hypothesis,  the  fact 

that  (c0,c  ,  •  •  •  ,e  )  »  (b  ,b  ,***,b.  )  and  the  fact  that  witli  x  held 

k  -1 

fixed  f ( x^ )  is  ISO  on  R 


Corollary  3.3.  Suppose  X  is  a  k-dimensi onal  random  vector  whose  distri¬ 
bution,  P^,  is  parameterized  by  the  vector  X  =  (X  ,X^,- •  •  ,  where 

satisfies  tlv*  hypotheses  of  Tlicorem  3.1  or  is  absolutely  continuous, 

Tk 

with  respect  to  the  product  measure  and  lias  dens.it. v  L  g»{X.  ,x.) 

i=l  1  1 

where  $»(•,•)  and  M  satisfy  the  hypotheses  of  Theorem  3.P.  If  the  ran¬ 
dom  variable  T  is  defined  by  T  =  f ( X )  where  f  is  ISO  then  for  any 
real  number  a 


PX[T2  a)  s  P  ,  [Ta  a] 


whenever  X  >>  . 


1 


1 1 

t 

Proof :  Note  that  any  nondoc  rear,  ing  function  of  iui  ISO  function  is  ISO  {. 

and  that  1^  ^  in  nondecreas i hr. 

An  alternative  way  of  stating  the  conclusion  of  this  corollary  in  that 
the  distribution  of  T  under  X  in  stochastically  larger  than  its  distri¬ 
bution  under  X*  .  If  T  is  a  test  statistic  for  a  tent  which  rejects  for 

i 

large  values  of  T  then  thin  conclusion  ntal.es  that  T  has  :ui  ISO 

t 

power  function. 


It.  Applications.  ,|  I 

i ! 

Kxample  U.i.  Suppose  we  have  independent  random  samples  from  each  of  k 

populations  indexed  by  the  parameters  0  ,  C., ,  •  •  •  ,  .  We  wish  t  o  use  our  ■  ' 

experimental  results  to  test  the  hypothesis 


V°,  *  ■"  “>» 


against  the  alternative  H  (i.e.,  I!  ^  but.  not.  where 


V6.  *  e,  *  =  v 


A  number  of  statistics  have  been  proposed  for  this  test.  One  collect. ion 


which  has  been  extensively  explored  is  based  on  the  differences  0.  -0, 

l  .1 

with  i  <1  where  ?).  is  an  estimate  of  0.  (of.  fleet. ion  in  barlow 

l  i 

et  al .  ( l‘>7;') ) .  For  example,  if  0.  is  the  memi  of  a  normal  population 

A 

then  0j  might  be  the  sample  mesui  of  the  sample  from  that  population. 


/ 


- - -B - 


i 


IllJlt.  I.  t 


Hi 


Now,  for  any  y,  h(y)=IT  L  (y.-y  (k-.’i  +  i)y., 

i  =  l,)  =  i+l  1  ■'  i  =  l  1 


♦  * :  * ! 


statistic,  formed  from  h(*),  is  a  special  case  of  a  more  gem-ral  con1  rad 

S  =  c.-G.  where  c  a  co  2:  •  •  •  Jr  are  prosper  i  fi  ed  cons  t  ant s .  The  fact 

that  the  function  s(y  ,y  ,  •  •  •  ,y  )  =  L  c.y.  is  I  HO  fo! lows  immediately 

1  k  i =]  i  i 

from  Theorem  P.S.  The  theory  in  Section  1  can  he  applied.  Suppose  0.  =  X. 
is  the  sample  mean  of  a  random  sample  of  size  n  from  a  normal  pops  1st  ion 

A  A  ~ 

having  mean  0.,  i=l,2,’”,k.  The  Joint  d  i  st  r  i  hut  i  on  of  (0  j  *C  ,,••••  )  .wit - 


isfies  the  hypothesis  of  Theorem  1.1  so  that  the  function  h(Q'  =  i  t  vO  ,  ^  t;  , 

=  Eg(i.i)  is  ISO.  In  other  words  we  would  expect  larger  value-,  of 
when  sampling  from  populations  with  parameters  conforming  more  closely  < 

11^.  In  addition,  the  test  rejects  for  large  values  of  so  that,  urine 

Corollary  1.3,  the  power  function  of  H  is  ISO. 

* 

Assume  that  0.  is  the  mean  of  a  Poisson  population  .-us!  that  0.  ~  X. 

l  ii 

is  the  mean  of  a  sample  of  size  n  from  that  populat  ion;  i  =  l,.’,,**,k. 

The  random  variable  n0.  has  a  Poisson  distribution  and  its  probability 

l 

function  satisfies  the  hypothesis  imposed  on  /(•,•)  in  Theorem  1..’. 

Tims,  Eg  [s(nG^  ,n0o,*  •  •  ,11^)  ]  =  riEg  |  s(  ^  ,0 , ,  •  *  •  ,  )  !  is  1  HO  and  the 
power  function  of  the  statistic  s(  0^  ,  G  )  is  ICO. 

A  second  class  of  test,  procedures  which  have  been  extensively  ex( loved 
in  the  literature  is  based  upon  mi  X,  distance  between  est  imnt.es  satis- 

fy  i  ng  the  alternative  hypotheses.  Spoci  fieal  ly  ,  if  0  is  an  mires  t.  r  i  et  ed 

.  k 

est.imat.e  of  G  then  in  =  1/k  L  0,  might,  be  u  reasonable  est  imate  of 

i  =  1  1 

the  common  value  of  G.  muter  H  .  G  =  P(0|c)  satisfies  II,  mid  would 

l  0  1  1 

be  a  reasonable  estimate  of  0  satisfying  this  restriction.  In  fad  ,  m 

.  k 

h:  the  projection  of  0  onto  the  col  lection  of*  points  x  in  K  such 


•V 


that,  x  -  x„  =  •  •  •  =  x^ 


).  A  test,  could  be  based  unon  the  r.tatistic 


Theorem  b 


then  the  function 


i.{  •  5 


_ Tf  y  =  F’(y|C)  for  each  y  C  R 


defined  on  R  by 


t(y  ) 


it-  ISO. 


f’roof:  Surpose  y  >>  x.  For 

any  z  €  C 

we  have 

,  by  Th. 

i-orem  .  1  , 

2^  (x.-y.'z.  -  'l'  (x.-y.)z. 

i  =  l  1  1  l  i=1  1  t  1 

/  — 
+  -  ( y  =  -y  i 

)/..  S  '! 
i 

i 

y  «  y.  Thus 

—  # 

x-y  t  C  and  us  in?  Section 

b  .  3  of  Barlow 

and  Brunk  (  l't 

V  )  we  opt  a  i  1; 

VK  _p  -,k  — p 

L  x.  &  L  y. .  This  yields 
i=  1  1  1  =  1  1 

the  desired 

resul  t 

i  nee 

t(y)  =  if  y^  -  k-1  •  [^  y .  r 

i=l  i  i=l  1 

and  y  »  x 

i mpl i e 

:*>  thn* 

,k 

..  y .  =  . .  x 

i  =  l  1  i -  : 

Thus,  the  theory  developed  in  Section  i  can  be  at r lied  to  stat  i •  i  es 
based  upon  the  function  t(*)>  If  the  population  indexed  by  G.  is  normal 
with  mean  G.  and  Known  variance  0  and  if  0.  i the  sample  mean  f  a 

i  l 

sample  of  size  n  from  that  population  then  T  =  tiG)  is  a  likelihood 
ratio  statistic.  The  distribution  of  T  under  iip  is  known  (of.  Harlow 
et  al .  (  i'J'.'P ) )  and  the  joint  distribution  of  8  sat  i  Ci.-s  tdie 

hypothesis  of  Theorem  3.1.  Thus  the  power  function  of  T^^  is.  ISC  .as.  a 
function  of  0.  As  with  S,  similar  conclusions  can  be  irawn  about  a  sta¬ 
tistic  based  upon  t(-)  under  other  distributional  assumptions  on  the 
populations.  Similar  conclusions  can  be  drawn  about  t tie  likelihood  ratio 

■  ■  w ) 

statistic  E‘~  pi  von  in  Barlow  et  al  .  (197*°)  when  the  population  variance, 

'  > 

C  , 


i  s  unknown . 


1 6 


A  third  statistic  which  has  been  proposed  for  testing  against 

H^-Hq  is  the  number,  L,  of  distinct  values  among  fl  ,  60 ,  •  •  •  ,  .  Let 

My)  be  the  number  of  distinct  coordinates  in  the  point  P(y|C).  If 
k  =  3 ,  y  *  =  (2 ,1  ,-3)  and  y  =  ( 7  ,-L  ,-3)  then  y  »  y '  while  X(y  )  =  P 
and  My')  =  3.  This,  of  course,  does  not  directly  imply  that  the  power 
function  of  statistics  based  upon  X(  • )  are  not  ISO.  However,  if  0 
is  a  vector  of  location  parameters  and  if  the  population  variances  are 
very  small  then  we  could  conclude  that  power  functions  of  statistics  based 
upon  i( • )  are  not  ISO. 

Robe r* son  and  Wegman  (1978)  consider  the  problem  of  testing  as  a 

*  _  '1 

null  hypothesis.  Consider  the  test  statistic  T  =  G  —  0 J,*"  which  is  the 

* 

square  of  the  distance  between  the  unrestricted  estimate  G  and  the 
restricted  estimate  6.  Define  the  function  t,  (•)  :H  — >  R  by 
tj  (j)  =  „y  -  P(y  jC)  |,‘  .  A  consequence  of  Theorem  .’.1  in  Robertson  mid 
Wegman  (l'Vtd)  is  th.at  t  (•)  *3  antitonic  wit  1  >  respect  ‘o  the  partial 

order  «  .  It  follows  from  the  theory  in  Section  3  that,  under  the  proper 
assumption.'  on  the  populations  ,  0  «*  O'  implies,  that  F.  z  Eq'-T,  .,1 

arid  ,  ?  f- 1  ir  p0/[TjO*t]  for  all  t  (P^th)  denotes,  the  probability 

of  F.  calculated  under  the  assumption  that.  6  is  the  population  vector 
of  parameters ) , 

Mow  if  G  ‘  =  ( G* ,0^, * • • ,0* )  has  the  property  that  0*=G,=  •••=0/ 
t.hen  0  »*  0 '  for  ail  6  (  C.  It.  follows  that,  homogeneity  {;  ) 

is  least  favorable  for  T  ,,  within  H().  Tims  if  t  tie  i  i  :t  r  i  but,  i  on  of 
under  is  known  then  conservative  rejection  regions  cati  te  const,  ruct.ed . 

In  the  normal  means  problem,  T  has  a  chi -bar-squared  distribution 
under  . 


( 

fn  MMiiiiiHi  it  i  • 
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As  far  as  we  can  determine,  the  next  two  examples  have  not  been 
explored  in  the  literature.  They  are  two  additional  restricted  inference 
problems  where  the  chi-bar-squared  distribution  arises.  In  fact,  the  dis¬ 
tribution  encountered  in  Example  2  is  a  continuous  distribution  as  con- 
trasted  with  previously  explored  x"  distributions  which  have  a  positive 
mass  at  0.  In  each  of  these  examples  if  the  underlying  distributions 
are  normal  the  estimates  turn  out  to  be  maximum  likelihood  and  the  test 
statistics  are  likelihood  ratio  statistics. 


Example  h.P.  Assume  we  have  k  populations  which  are  completely  speci¬ 
fied  except  for  the  values  of  k  parameters  0^  ,0o  ,  •  •  •  , 0^  indexing  these 
populations.  Suppose  T  is  known,  is  a  possibility  for  0,  and  that  wo 
wish  to  test  the  null  hypothesis  :0  »T-  This  hypothesis  is  not 
simple,  in  the  sense  that  it  completely  specifies  the  distribution  of  the 
test  statistic  of  interest.  However,  the  theory  in  Section  Three  can  be 
used  to  show  that  :  0  =  T  is  a  least  favorable  confi  duration  within 
H^.  Moreover,  the  distribution  of  our  test  statistic  is  completely  speci¬ 
fied  under  and  turns  out  to  be  a  chi -bar-squared  distribution.  Detail: 

of  this  analysis  follow. 


AAA  A 

Assume  that  0  »  (0 ,0.,,’  •  •  ,6  )  is  a  Rood  unrestricted  estimate  of  0. 

1  K 

Tlie  first  problem  is  to  find  an  estimate  of  0  which  satisfies  our  null 

hypothesis.  The  hypothesis,  H  ,  can  be  written  in  term::  of  the  Fenchej 

#  £ 

dual  C  of  the  cone  C.  Specifically,  H  :  T  -  6  €  C  so  that  we  eon- 

—  «  p 

sider  an  estimate,  0,  which  minimizes  l{  0)  =  X.  (0.  -  0.  )‘  subject,  to 

i  =  l  1  1 

T  -  0  €C*.  This  is  equivalent  to  minimizing  £  f(T.  —  0.  )  -  (T.  -  0.  )f 


/ 
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subject  to  T-8  €  C* .  The  solution  for  r-6  is  P(t-8|c*)  so  that 

(k.i)  e  =  t-p(t  -  e|c*). 

Now,  P(y|C#)  =  y-P(yjc)  (cf.  Section  i* .  3  of  Barlow  and  Brunk  (1972))  so 
that  another  way  of  representing  8  is 

(h.2)  0  =  0  +  P (t  - 6 ] C ) . 

A  third  representation  for  0  can  be  obtained  by  considering  the  s.et 

k 

A  =  (z;  z  »  TJ  which  is  a  closed  convex  subset  of  R  (not.  a  <'<>n« • ) . 
Suppose  z  €  A  and  consider 

(e-e/e-z)  =  (p(t- g|c),(t  -  e) -p(t  -  01D)  -  (p{t  -  or),T  -  7.) 

using  (4.2).  The  first  term  on  the  right  is  zero  and  the  second  i  erm  is. 
nonpositive  since  P(t-6|C)  €  C  and  T-z  €  C  .  It  follows  from  Theorem 
2.2  of  Bru.nk  (1965)  that  6  =  P(8|a). 

From  Theorem  P.3  of  Brunk  (l965)/the  projection  operator  P(-|a)  is. 
continuous  so  that  if  0  is  a  consistent  estimator  of  6  i  hen  so  is.  0. 
Now,  let's  turn  to  our  tenting  problem.  Consider  'he  test  s.tut  i  s.  t  i  <■ 

A  _  O 

T  =  L  (8.-0.)'  for  testing  H  against  ||  .  tiring  (4.2), 

i c  i  i  1  J 

T,  =  L  P(T  -  0  1 C )  V  and  it  is  argued  in  the  pro  of  of  Theorem  4.1  'tint 

12  i=j  l 

the  funct  ion  t(y  )  =  L  P(y  jc)'.  is  ICO.  U»t.  Y  .  =  i .  -  C .  ;  i  =  1  ,, 1 ,  ■  •  •  ,k 

i=l  1  111 

and  (assuming  G  is  unbiased  for  0)  let  v.  =  F.(Y.  )  -  T.  -  C.  .  Making 

i  il; 


i 

k 


< 
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the  required  assumptions  about  the  underlying  populations  and  using  Corol¬ 


lary  i.  1  we  see  that  if  6  «  6'  (i.e.,  V  »  v' )  then  PglT^if] 

S  Pg,fTi  ,^t|.  Now,  0  ^  T  for  all  6  satisfying  so  that,  for  suoh 

0,  Tg!  ,  2  t.  ;  s  [T^.,  2  t  ].  Thus,  in  testing  H  ^  :  0  »  T,  the  subhy- 

pothesis  :  G  =  T  is  least  favorable  and  if  the  distribution  of  T^  ? 
can  be  determined  under  ii^  then  eonservat.i  ve  e  r  i  t.  i  ea!  regions  e;ui  be  <vn- 
s trust ed . 

Consider  the  normal  means,  problem  (i.e.,  the  distribution  correspond- 
ing  t.o  G.  is  normal  with  mean  0.  and  variance  Cf  ,  which  is  known, 

i  i 

and  Q.  is  the  sjunple  mean  from  the  i~  population).  Let  Y  =  k  Y.. 

t  0  i=1  i 

'  '  )/  > 

The  distribution,  under  H  ,  of  R  =  (n/c  )L  ( T(  Y  |0 ) .  -  Y  )*  is,  from 

()  i  =  i  10 

Theorem  1.1  in  Barlow  et  al  .  (lO'fp),  a  eh i -bar-squared .  Moreover, 

. '  o  ' 

(n/O  )T  =  R  +  k(n/ct  )Y‘^  so  t.imt  (n/cr  )T,.,  is  t  lie  sum  of  two  independent 

random  variables,  one  having  a  standard  chi -squared  distribution  and  the 

other  having  a  chi -bar-squared  distribution.  The  following  theorem  is  a 
consequence . 

Theorem  it .  •>  ■  Suppose  we  have  random  samples  of  sire  n  from  each  of  k 


norma!  pops t at  i ons  having  moans  G  ,G  , , ■ 


,0^  atiii  eaeii  having  variance 


t  Known 


hot,  T,  ,  be  the  likelihood  ratio  statistic  leceribed  above 


for  *  es.  t.  i  nr  ri ,  :  C  »  t  against  all  alternatives..  Then 


•>il  '  , 

ecu,  0 


t  1  =  P  ;T  s  t  !  =  r*  P(  Jf  ,k  )p!x'#-  1  1 

1  1  7=1  1 


for  all  real  t  where  P(/,k)  its  given  by  *  he  recursion  formula  in  Corel' 
I  ary  B  on  page  i  h  ■■  .if  Bur  low  et  al.  (W7P'. 

It,  is  interesting  to  note  that  *his  chi  -bar-squared  d  i  si  r  ibut.  ion 
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differs  from  those  previously  studied  in  that  it  is  absolutely  continuous 

and  the  others  have  a  positive  mass  at  zero. 

The  statistic  T._  =  ( T.  -6.)^  might  be  used  for  testing 

01  i=2  xx  0 

against  the  alternative  In  the  normal  means  problem  the  statistic 

2  2  2 

(n/c  )T  ,  =  (n/a  )L  (Y.  —  P ( Y } C ) . )  is  the  likelihood  ratio  statistic 
01  i=l  1  i 

studied  by  Robertson  and  Wegman  (1978)  for  testing  the  null  hypothesis 

E(Y^)  ^  E(Y^)  S  s  E(Y^).  It  follows  from  their  results  that  under 

2 

Hq  (i.e.,  E(Y^)  =  0;  i=l,2,"*,k),  (n/a  )T  has  a  chi-bar-squared 

2  p 

distribution.  Specifically,  P[(n/o^)T  it]  =  IT  P(i,k)  P[v  2  t .] , 

OX  Xs- X  K-x 

provided  is  true. 


Example  U . 3 ■  Suppose  we  have  a  random  sample  of  size  n  from  each  of 

2 

2-k  normal  populations,  each  having  variance  a  (known)  and  with  means 
, • • • ,m^ ,  v  ,v2 , • • • ,v^.  Let  the  corresponding  sample  means  be 
,x? , • • • ,x^ ,y^ ,y^ , • • • ,yk-  We  consider  testing  the  null  hypothesis 
:  pi  »  v.  As  in  Example  b.2,  does  not  completely  specify  the  distribu¬ 
tion  of  our  likelihood  ratio  statistic.  However,  H  :  pi  *  V  :  r  least  favorable 
and,  under  H^,  the  distribution  of  our  statistic  is  a  chi-bar-squared. 
Details  are  given  in  the  next  few  paragraphs. 


The  first  problem  is  to  find  the  maximum  likelihood  estimates  which 

satisfy  H  .  These  estimates  minimize  L(pt,v)  =  I?*  [  ( pi.  -x .  )?  +  ( v. -y .  )c  ] 

1  i=l  1  1  1  1 

subject  to  H^. 

Theorem  U.5.  If  (p^v)  are  the  maximum  likelihood  estimates  subject  to 


then 
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U.  +  V.  =  x.  +y. 
1  1  i  i 


Proof:  Consider  the  i —  term  in  L(-,*)  and  suppose  ((X  ,v. )  j-  (x^y^). 
Let  g(  e)  =  (ni  +  e-xi)  +  (\t  +e-y.)  .  Consider  g '[  • )  and  note  that  if 
g7(o)  ^  0  then  there  exists  an  e  /  0  such  that 

L(Hi  ,M2 ,  •  •  •  ,Ui_i  ,Mi  +  e,*  •  •  ,v  ,  •  •  •  ,v.  +  e,  •  •  •  ,vfe)  <L(m,v).  Moreover, 

if  (pi,v)  satisfies  so  does  this  new  point.  Thus  at  (|i,v),  g/(0)  =0 

for  each  term  and  the  desired  result  follows. 

Thus  \t  =  x^  -  pt  +y^  and  our  problem  reduces  to  finding  |i.  Spe¬ 
cifically,  we  wish  to  find  pi  which  minimizes 


i(|i)  =  2  •  *L  (x.  -  pi.  r 
i  =  l  1  3 


subject  to  the  restrictions 


E*  2  •  n,  s  (x  +  v  ) , 

,1  =  1  J  J=1  J  •’ 


i  =l,2,-*-,k  with  equality  when  i  =  k.  It  is  convenient  to  recast  our 

problem  in  terms  of  8  and  z  where  8  =  (pi.  -x  )  and  z  =  (y,-x.)/2 

J  J  J  J  .1  J 

i=l,2,*",k.  In  this  notation  we  wish  to  minimize  L  8.  subject  to 

i=l  1 

the  restriction  L  (z  -  8  )  S  0:i=l,2, —  ,k  with  equality  for  i  =  k. 
J  =  1  ..  J 

# 

This  is  equivalent  to  requiring  that  z-8  €  C  .  By  Theorem  S-3*  of  Barlow 
and  Brunk  (1972)  the  solution  for  8  is  G  =  P(zlc).  Thus 


(U.3) 


=  P(X=3L  I  Oj  +  x. 


h  -  p(^ !  c)s 


Now,  returning  to  our  testing  problem,  if  \  is  the  likelihood 

ratio  for  testing  against  ~  then  =  -2  In  = 

2  k  _  _  2  _  _ _ 

(n/2C  )Y.  P(y-x|c)..  The  random  variables  y.  -  x.  ;  i  =  l,2,---,k  are 

i=l  1  ii 

—  —  2 

independent  and  y^  -  x^  -  M.  ,  20  /n).  Thus  as  in  Example  b.2,  T 

has  a  chi -bar-squared  distribution  under  :  pi  =  V  and  is  least  fav¬ 

orable  within  H  ,  using  Corollary  3.3.  Conservative  critical  regions  can 
be  constructed. 

If  \  is  the  likelihood  ratio  for  testing  vs.  H^-H^  an^ 

T  =  -2  In  then  this  statistic  can  be  written 

T  =  (n/2  a2)^  [  (y.  -  x.  )  -  P(y  -  xlc) .  ]2 . 

01  ii  'i 


It  follows  from  Corollary  2.6  of  Robertson  and  Wegman  (1978)  that,  under 
H0,  T  has  a  chi-bar-squared  distribution.  Specifically, 

p'Toiitl  ■  4iPU-k,P[x\-iatl- 

6.  Weighted  inferences.  The  assumptions  of  a  common  known  variance  and 
equal  sample  sizes  can  be  relaxed  in  some  of  the  distribution  theory  in 
Section  U.  We  define  a  weighted  version  of  the  ordering  «.  Specifically, 


suppose  it  ,a'g ,  •  •  •  ,id^  are  positive  weights  and  define:  x  >>^  y  if  and 


only  i 


;  if  L'1  x .  ai.  s  7'"1 


i=l  1  i 


y.U).  for  j=l,2,*",k  with  equality  for  j  =  k; 


1=  L 


l  l 


f  :  R,  — *  R  is  ISO  provided  f  is  isotonic  with  respect  to  <<  ; 

X  ID  ID 

k  p 

(x,y)  =  IT  x.y  id.  ;  ![x|l~  =  (x,x)  ;  P  (xlc)  is  the  projection  of  x 

id  i=i  111  "  ID  ID  ID 

onto  C  with  respect  to  the  norm  I!*  I!  and  C*111  =  f  z  €  R,  ;  (x,z)  £  0 

11  ID  1  k  II) 

V  x€C].  The  characterization  result,  Theorem  2.1,  becomes  x  »  y  if 


and  only  if  y-x  €  C* 


ID 


* 

i. 


and  the  results  of  Section  Two  are  valid  for  thin 
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weighted  ordering.  The  analogue  of  Theorem  2.5  says  that  f^x)/^  ^ 

fi+l(x)/uu.+1  for  all  x  and  for  i  =  1 ,2,  •  •  •  ,k-l  implies  that  f  is 

ISO  .  Theorem  3.1  and  the  corresponding  portion  of  Corollary  3-3  are  valid 
uu 

in  this  general  setting. 

In  Example  U.l,  if  0^  is  the  mean  of  a  normal  population  with  var- 
2 

iance  Cp  and  if  8^  is  the  mean  of  a  sample  of  size  rg  from  that  pop- 

.  2  , 

ulatxon  and  if  U).  =  n./c,  for  i=l,2,-*-,k  then  s  (as  defined  m  that 

ill 

example)  is  ISO^  an<i  the  Power  function  of  the  associated  test  is  ISO^, 

provided  c./u).  2  c.  /uj.  ,  ;  i  =  1 ,2,  •  •  *  ,k-l .  The  likelihood  ratio  sta- 
ii  l+l  l+l 

tistic  fortesting  H.  :  0  =  80  =  •  •  •  =  8,  vs.  H,  -H.,  where  H,  :0.  2  8. 

0  12  k  10  11  2 

2  2  0,  is  T„,  =  £  ut>.  ( 8.  -  m)c  where  m 

k  01  i=1  i  i 


,k  ^ 

m.  0 . 1 i-  ui.  and 
i=l  i=i  i 


8  =  P^(8|C).  If  one  modifies  the  proof  of  Theorem  U.l  appropriately  then 


it  is  seen  that  the  power  formation  of  the  likelihoo  ’  ratio  test  is  ISO 


in 


In  the  same  example,  the  likelihood  ratio  test  statistic  for  testing 

H,  vs.  ~  H,  is  T,.  =  uu.(8.  -  P  (QlC).  )"  .  The  correspondi  ng  function 

1  1  12  3  =  1  li  id  i 

is  antitonic  with  respect  to  «*  and  the  least  favorable  status  for 
within  can  be  obtained. 

Similarly,  the  distribution  theory  in  Examples  )|.2  and  '<.3  can  be 
obtained  for  the  normal  means  problem  without  assuming  equal  weights.  One 
complication  in  these  results  is  that  the  coefficients,  P(£,k),  in  the 
chi -bar-squared  distribution  now  depend  on  ,«),,,•••  ,u^  and  can  be  dif¬ 
ficult  to  compute  (cf.  Robertson  and  Wright  (1980)). 


2U 
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